Papers with dialogue generation
Copied to clipboard
| Challenge: | Existing large language models (LLMs) struggle to generate emotional support response, despite observing and reflecting on the help-seeker’s situation . Empathy drives the formation of constructive interpersonal and supportive relationships, including counseling for mental health care . |
| Approach: | They propose to use a two-stage training process to enhance empathetic response generation through empathy acquisition and emotional validation alignment. |
| Outcome: | The proposed method significantly improves empathetic response generation, achieving superior performance in both automatic and human evaluations. |
Copied to clipboard
| Challenge: | Using large language models, we can generate accurate, context-aware responses with minimal prompts. |
| Approach: | They propose a system that integrates domain-specific large language models with advanced information retrieval techniques to deliver comprehensive and context-aware responses. |
| Outcome: | The proposed system improves quality of dialogue generation and improves efficiency in the biomedical and pharmaceutical domains. |
Copied to clipboard
| Challenge: | Meta-learning is a new technique that aims to learn better learning algorithms, including better parameter initialization, optimization strategy, network architecture, distance metrics, and beyond. |
| Approach: | This tutorial introduces Meta-learning approaches and the theory behind them, and then reviews the works of applying this technology to NLP problems. |
| Outcome: | This tutorial will introduce Meta-learning approaches and the theory behind them, and then review the works of applying this technology to NLP problems. |
Copied to clipboard
| Challenge: | Curriculum Data Augmentation (CDA) presents synthetic data with increasing difficulties to neural models. |
| Approach: | They propose a curriculum-aware paraphrase generation module with bottom-k sampling and cyclic learning strategy that passes through the curriculums multiple times. |
| Outcome: | The proposed framework surpasses competitive baselines on few-shot text classification and dialogue generation. |
Copied to clipboard
| Challenge: | Existing methods to measure diversity of chitchat model responses have been proposed to measure iteratively. |
| Approach: | They propose a metric which uses Natural Language Inference to measure the semantic diversity of a set of model responses for a conversation. |
| Outcome: | The proposed metric improves the diversity of a sampled set of responses using a new generation procedure called Diversity Threshold Generation. |
Copied to clipboard
| Challenge: | Recent research has focused on predicting crimes, predicting outcomes of judicial debates, and extracting information from legal documents. |
| Approach: | They propose to use a large-size Court Debate Dataset to analyze court debates . they invite experienced judges to design appropriate labels for data records . |
| Outcome: | The proposed dataset includes 30,481 court cases, totaling 1,144,425 utterances. |
Copied to clipboard
| Challenge: | a growing interest in neural dialogue generation systems is focusing on generating human-like responses based on past utterances . despite efforts, few consider putting restrictions on the response itself . authors present three models that concatenate the desired emotion with the source input . |
| Approach: | They propose three models that concatenate the desired emotion with the source input or push the emotion in the decoder. |
| Outcome: | The proposed model is more efficient than the previous models, but it lacks the emotion vector. |
Copied to clipboard
| Challenge: | Existing methods to recommend items are categorized into attribute-based and generation-based methods. |
| Approach: | They propose to represent items in natural language and formulate a conversational recommender system that can be optimized in a single stage without relying on non-textual metadata. |
| Outcome: | The proposed model can be optimized in a single stage, without relying on non-textual metadata such as a knowledge graph. |
Copied to clipboard
| Challenge: | Experimental results show PLATO-XL achieves state-of-the-art results across multiple conversational tasks. |
| Approach: | They propose to train PLATO-XL models with up to 11 billion parameters, trained on Chinese and English social media conversations. |
| Outcome: | The proposed model achieves state-of-the-art on multiple conversational tasks, verifying its potential as a foundation model of conversational AI. |
Copied to clipboard
| Challenge: | Existing work on sequence-to-sequence dialogues treats the KB query as an attention over the entire KB without the guarantee that the generated entities are consistent with each other. |
| Approach: | They propose a framework which queries the knowledge base in two steps to improve consistency . they first return the most relevant KB row given a dialogue history . |
| Outcome: | The proposed framework outperforms baseline models and produces entity-consistent responses. |
Copied to clipboard
| Challenge: | Neural approaches have improved machine comprehension tasks, but models often operate as a black-box, resulting in lower interpretability. |
| Approach: | They propose a hybrid approach to quantify model uncertainty using Bayesian weight approximation and boost up inference speed by 80% relative to test time. |
| Outcome: | The proposed approach boosts inference speed by 80% relative to the previous approach and is applied to a clinical dialogue comprehension task. |
Copied to clipboard
| Challenge: | Goal-directed dialogue systems aim to proactively reach a pre-determined target through multi-turn conversations. |
| Approach: | They propose a coherent dialogue planning approach that uses a stochastic process to model the temporal dynamics of dialogue paths. |
| Outcome: | The proposed approach generates more coherent utterances and achieves the goal with a higher success rate. |
Copied to clipboard
| Challenge: | Existing knowledge-enhanced methods only seek knowledge from a single source, resulting in insufficient coverage of a given knowledge source. |
| Approach: | They propose to use multiple independent decoder heads to infuse multi-source knowledge into dialogue generation more efficiently by incorporating external knowledge into the dialogue generation. |
| Outcome: | The proposed approach overcomes three challenges in infusing multi-source knowledge into dialogue generation more efficiently. |
Copied to clipboard
| Challenge: | Sentence function is an important linguistic feature indicating the communicative purpose of a sentence in a conversation. |
| Approach: | They propose a structured meta-learning approach for dialogue generation on infrequent sentence functions. |
| Outcome: | The proposed approach improves informativeness and relevance of dialogue generation on infrequent sentence functions while preserving knowledge generalization for similar sentence functions. |
Copied to clipboard
| Challenge: | Current approaches for controlling dialogue response generation focus on high-level attributes like style, sentiment, or topic. |
| Approach: | They propose a method that allows for more fine-grained control of dialogue response generation . they propose utterances that encourage the generation of control words in the future . |
| Outcome: | The proposed method outperforms state-of-the-art constrained generation baselines on task-oriented dialogue datasets and shows that it is more fine-grained than previous methods. |
Copied to clipboard
| Challenge: | Existing zero-shot dialogue generation systems rely on large-scale pre-trained language models. |
| Approach: | They propose a multilingual learning framework for zero-shot dialogue generation that can transfer knowledge from an English corpus to a non-English corpus with zero samples. |
| Outcome: | The proposed framework can transfer knowledge from an English corpus to a non-English corpus with zero samples. |
Copied to clipboard
| Challenge: | Language models often generate fluent and convincing content but can lack consistency with the provided source, resulting in potential inaccuracies. |
| Approach: | They propose a new decoding method that augments the contrastive search framework with context-aware regularization terms to promote tokens that are semantically similar to the provided source while penalizing repetitiveness in the generated text. |
| Outcome: | The proposed method improves faithfulness across various language models while maintaining output diversity comparable to well-performing decoding algorithms. |
Copied to clipboard
| Challenge: | 'BanglaNLG' is a comprehensive benchmark for evaluating natural language generation models in Bangla, a widely spoken yet low-resource language. |
| Approach: | They propose to aggregate six conditional text generation tasks under the BanglaNLG benchmark and introduce a new dataset on dialogue generation in the process. |
| Outcome: | The proposed model outperforms several multilingual models by 9% absolute gain and 32% relative gain on all of these tasks. |
Copied to clipboard
| Challenge: | Existing tools to fine-tune Large Language Models for specific tasks are limited due to financial constraints and limited availability of human experts. |
| Approach: | They propose a human-in-the-loop framework for the knowledge-driven generation of synthetic dialogues using LLM prompting that implements different strategies of data collection that require different user intervention during dialogue generation. |
| Outcome: | The proposed framework reduces post-editing efforts and improves quality of generated dialogues. |
Copied to clipboard
| Challenge: | integrating cultural dimensions with dialogue encoding features can enhance the predictive accuracy and quality of dialogue agents. |
| Approach: | They propose to incorporate cultural dimensions into dialogue encoding features to enhance the predictive accuracy of dialogue agents. |
| Outcome: | The proposed model improves the accuracy and quality of dialogue predictions by incorporating cultural dimensions with dialogue encoding features. |
Copied to clipboard
| Challenge: | Existing approaches to training dialogue models have low diversity in open-domain contexts . prior art suggests that naive MLE objective is not effective enough . |
| Approach: | They propose to incorporate contrastive learning into dialogue generation by using a pretrained baseline model as a reference. |
| Outcome: | The proposed framework is suited for training a wide range of dialogue generation models with favorable performance over baseline training approaches. |
Copied to clipboard
| Challenge: | Using different decoding algorithms, we find that human dialogue generation is beneficial for adherence to the Uniform Information Density principle. |
| Approach: | They investigate whether decoding algorithms implicitly follow the Uniform Information Density principle by distributing information evenly in utterances. |
| Outcome: | The proposed method encourages non-uniform responses, but under low/high surprisal conditions, resulting in poor quality responses. |
Copied to clipboard
| Challenge: | Experimental results show that our model can generate semantically coherent responses compared to baseline models. |
| Approach: | They propose an Auto-Encoder Matching model to learn utterance-level semantic dependency . their model contains two auto-encoders and one mapping module . |
| Outcome: | Experimental results show that the proposed model can generate high coherence and fluency compared to baseline models. |
Copied to clipboard
| Challenge: | a new study aims to develop a design framework for multilingual interactive agents . large amounts of data and language resources are needed to develop most key components . |
| Approach: | They propose a general design framework for multilingual interactive agents in specialized domains with small or non-existent dialogue corpora. |
| Outcome: | The proposed framework integrates external language services for supporting multilingual functions and realizes context-aware dialogue generation under the situation of small corpora. |
Copied to clipboard
| Challenge: | a new benchmark for hallucination-free dialogues is based on knowledge-based conversational models that generate unsupported utterances . a recent study shows that models that are trustworthy generate unverifiable or factually incorrect statements . |
| Approach: | They propose a data-centric solution to edit hallucinated responses in the Wizard of Wikipedia benchmark. |
| Outcome: | The proposed model improves on the Wizard of Wikipedia benchmark while maintaining engaging conversations. |
Copied to clipboard
| Challenge: | Existing benchmarks for Arabic are limited, but they can be used to measure performance of different languages. |
| Approach: | They propose a benchmark for Arabic that addresses the need for a framework dedicated to Arabic languages and varieties. |
| Outcome: | The proposed benchmark covers 13 different tasks in Arabic and spans 50 test splits. |
Copied to clipboard
| Challenge: | Pre-trained transformers are popular in state-of-the-art dialogue generation systems . however, they are vulnerable to adversarial samples crafted by small and imperceptible perturbations. |
| Approach: | They propose a multi-objective attack method that balances two objectives: generation accuracy and length. |
| Outcome: | The proposed method significantly degrades state-of-the-art DG models with a higher success rate than traditional accuracy-based methods. |
Copied to clipboard
| Challenge: | Existing knowledge selection tasks require the preidentified knowledge to generate informative dialogues. |
| Approach: | They propose a novel method to supervise knowledge selection when the gold knowledge label is unknown by obtaining an oracle knowledge label via distant supervision and leverage knowledge distillation to alleviate the noisy labeling problem of distant supervision. |
| Outcome: | The proposed method outperforms strong supervised baselines on two knowledge-grounded dialogue datasets and generates more informative responses. |
Copied to clipboard
| Challenge: | Existing methods for retrieving relevant memories from an external database are coarse-grained and can cause noise and focus on crucial memories. |
| Approach: | They propose a multiple partition paradigm for RAG where each database partition serves as a basic unit for execution. |
| Outcome: | The proposed framework outperforms baseline methods on three language generation tasks on seven datasets. |
Copied to clipboard
| Challenge: | Existing studies show that explicitly modeling concept flows with a large commonsense knowledge graph improves response quality, but there is a gap between the knowledge graph and the conversation. |
| Approach: | They propose to model human conversational concept flows with a commonsense knowledge graph . they extract abundant concepts and relations from natural conversations and build a conversation-aware knowledge graph. |
| Outcome: | The proposed method performs better than baselines on a large-scale reddit conversation dataset. |
Copied to clipboard
| Challenge: | Generating natural and informative texts has been a long-standing problem in NLP. |
| Approach: | They propose to augment TExt Generation via Task-specific and Open-world Knowledge in a unified framework. |
| Outcome: | The proposed model can learn what and how to generate on two text generation tasks. |
Copied to clipboard
| Challenge: | Recent advances in automatic data augmentation have focused on computer vision tasks where it is easy to apply imperceptible perturbations without changing an image’s semantic meaning. |
| Approach: | They adapt AutoAugment to automatically discover effective perturbation policies for natural language processing (NLP) tasks such as dialogue generation. |
| Outcome: | The proposed algorithm reduces data-level model bias by using a controller trained on the target task. |
Copied to clipboard
| Challenge: | Motivational interviewing (MI) is a client-centered counseling technique that encourages individuals to change behaviors through emphatic conversations. |
| Approach: | They propose to use large language models to generate more controllable dialogues with explainability by prompting LLMs to predict appropriate strategies as reasoning and utilizing these strategies to guide dialogue generation. |
| Outcome: | The proposed model generates more controllable and explainable dialogues with a set of MI skills. |
Copied to clipboard
| Challenge: | Recent research attention in task-oriented dialogue systems focuses on end-to-end neural models. |
| Approach: | They present a dataset that combines annotated corpora from four domains to provide a unified ontology and annotation schema for task-oriented dialogues. |
| Outcome: | The proposed dataset improves language, information content and performance in dialogues with two recent models. |
Copied to clipboard
| Challenge: | End-to-end neural dialogue generation does not employ knowledge to guide the generation. |
| Approach: | They propose a neural knowledge diffusion model to introduce knowledge into dialogue generation. |
| Outcome: | The proposed model outperforms baseline models on a real-world dataset. |
Copied to clipboard
| Challenge: | Existing alternatives lack round-level granularity and controllability, making it difficult to analyze how victim profiles and psychological states shape tactic effectiveness. |
| Approach: | They propose a multi-agent architecture that generates structured phishing simulations grounded in crime-script procedures and persuasion principles. |
| Outcome: | The proposed framework captures tactic concentration, vulnerability transitions, and web-search-induced procedural disruptions across 571 rounds. |
Copied to clipboard
| Challenge: | Experimental results prove the superiority of our proposed method on challenging classification tasks. |
| Approach: | They propose a task-level thinking step that eliminates bias introduced by demonstrations . they propose 'progressive revision framework' which can improve the thinking steps by correcting hard demonstrations. |
| Outcome: | The proposed method achieves best performance on three kinds of classification tasks in zero-shot and few-shot settings. |
Copied to clipboard
| Challenge: | Prompt-tuning is an increasingly popular parameter-efficient method for adapting large pretrained language models to downstream tasks. |
| Approach: | They propose an instance-specific prompt-tuning algorithm for dialog generation that generates prompts based on instance-level control code rather than the conversation history. |
| Outcome: | The proposed prompt-tuning module is a fraction of the size of the pretrained language model and saves memory and expensive storage space. |
Copied to clipboard
| Challenge: | Conventional reference-based metrics have low correlation with human judgments, especially for open-ended generation tasks. |
| Approach: | They propose to use large language models as reference-free NLG evaluators to assess the quality of NLG outputs. |
| Outcome: | The proposed framework outperforms all previous methods in two generation tasks, and has a Spearman correlation of 0.514 with human on summarization task, and a large variance in human judgments. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have impressive capability to resolve a wide range of NLP tasks by fine-tuning high-quality instruction data. |
| Approach: | They propose a method to generate huge truthful and customized dialogues without worrying about factual errors caused by the model hallucination. |
| Outcome: | The proposed method solves the model hallucination in dialogue generation by restricting the LLMs to leverage the given reference instead of reciting their own knowledge to generate dialogues. |
Copied to clipboard
| Challenge: | Existing methods for dialogue generation use an external knowledge base to generate appropriate responses. |
| Approach: | They propose to use an external knowledge base to generate appropriate responses for unseen entities. |
| Outcome: | Experiments on two dialogue corpus show that pre-trained models perform poorly with unseen entities. |
Copied to clipboard
| Challenge: | Existing research on customer service dialogue generation generates generic responses from sellers . however, such cost prohibits small businesses, and multiturn dialogue generation is becoming more popular. |
| Approach: | They propose a novel and extensible dialogue generation method by leveraging sellers’ historical dialogue information to generate generic seller responses. |
| Outcome: | The proposed model can generate high-quality responses that cater to specific sellers’ characteristics and exhibit consistent superiority over baselines on a real-world multi-turn customer service dialogue dataset. |
Copied to clipboard
| Challenge: | Goal-oriented dialogue systems are now being widely adopted in industry where it is of key importance to maintain a rapid prototyping cycle for new products and domains. |
| Approach: | They propose a data-driven approach to goal-oriented dialogue generation which only uses a few example dialogues, none of which has to be annotated. |
| Outcome: | The proposed approach significantly improves upon baseline models and over the previous state-of-the-art model, ZSDG. |
Copied to clipboard
| Challenge: | Existing research on building ES conversation systems only considered single-turn interactions with users, which is over-simplified and has limited support for multi-turn systems. |
| Approach: | They propose a multi-turn ES conversation system that uses lookahead heuristics to estimate future user feedback after using particular strategies. |
| Outcome: | The proposed system significantly outperforms baselines in both dialogue generation and strategy planning. |
Copied to clipboard
| Challenge: | Recent research focused on knowledge distillation methods where the underlying relationship between the facts in a knowledge base is not effectively captured. |
| Approach: | They propose a novel task-oriented dialogue system that effectively incorporates knowledge into a language model by using structural information of a knowledge graph. |
| Outcome: | The proposed system views relational knowledge as a knowledge graph and introduces (1) a structure-aware knowledge embedding technique, and (2) a Knowledge graph-weighted attention masking strategy to facilitate the system selecting relevant information during the dialogue generation. |
Copied to clipboard
| Challenge: | Tuning language models for dialogue generation has been a prevalent paradigm for building capable dialogue agents. |
| Approach: | They propose a multi-round interactive dialogue tuning framework that models the speaker roles of agent and user separately. |
| Outcome: | The proposed framework performs superior to fine-tuning and improves dialogue consistency. |
Copied to clipboard
| Challenge: | Variational Autoencoder (VAE) is widely used to approximate a model’s posterior on latent variables. |
| Approach: | They propose to let the Kullback–Leibler divergence individual follow a distribution across the whole dataset and analyze that it is sufficient to prevent posterior collapse by keeping the expectation of the KL’s distribution positive. |
| Outcome: | The proposed approach can avoid posterior collapse effectively and efficiently without introducing any new model component or modifying the objective. |
Copied to clipboard
| Challenge: | Existing methods to control dialogue generation are manual labelling and manual editing of data. |
| Approach: | They propose a method to control dialogue generation using exemplar responses . they use semantic frames present in exemplars to guide response generation . |
| Outcome: | The proposed model improves coherence while preserving semantic meaning and conversation goals . exemplar responses are handwritten or strategically curated to promote highlevel goals without explicit labels . |
Copied to clipboard
| Challenge: | emergence of large language models (LLMs) improves capabilities of dialogue systems . but they lack communication skills, which make them more like information seeking tools . |
| Approach: | They propose to empower LLMs with communication skills through inner monologues . they use a benchmark to evaluate the dialogue generation ability of the model . |
| Outcome: | The proposed model outperforms the baselines in the evaluation of communication skills. |
Copied to clipboard
| Challenge: | Existing graph neural networks (GNNs) teach message passing on a graph from text, resulting in a semantic gap between graph knowledge and text. |
| Approach: | They propose a framework to integrate external graph knowledge into chatbots by coagulating representations of both text and graph knowledge. |
| Outcome: | The proposed framework outperforms state-of-the-art (SOTA) baselines on dialogue generation. |
Copied to clipboard
| Challenge: | Open-ended text generation tasks require models to generate coherent continuation given limited preceding context. |
| Approach: | They propose a novel two-stage method which explicitly arranges ensuing events in open-ended text generation tasks. |
| Outcome: | The proposed method improves coherence and diversity of open-ended text generation tasks. |
Copied to clipboard
| Challenge: | Empirical results indicate that pre-trained language models can significantly outperform state-of-the-art methods in both automatic evaluation and human judgment. |
| Approach: | They propose to equip a pre-trained language model with a knowledge selection module to generate knowledge-grounded dialogues. |
| Outcome: | The proposed model outperforms state-of-the-art methods in evaluation and human judgment. |
Copied to clipboard
| Challenge: | Existing knowledge-grounded dialogue models lack prior and posterior knowledge selection . prior selection module may not learn to select knowledge properly because of lack of posterior information . |
| Approach: | They propose a knowledge distillation-based training strategy to remove the exposure bias of knowledge selection. |
| Outcome: | The proposed model improves on two knowledge-grounded dialogue datasets. |
Copied to clipboard
| Challenge: | a new method to induce societal biases in natural language generation is being developed . a method to equalize the amount of biased text across demographics is effective . |
| Approach: | They propose a method to induce societal biases in natural language generation by using demographic inequalities. |
| Outcome: | The proposed method is effective at equalizing biases across demographics while generating less negatively biased text overall. |
Copied to clipboard
| Challenge: | Existing personalized dialogue agents model persona profiles from sparse or dense persona descriptions and dialogue histories. |
| Approach: | They propose a model that clusters dense persona descriptions into sparse categories and generates personalized responses from dialogue histories. |
| Outcome: | The proposed model improves on Chinese and English datasets. |
Copied to clipboard
| Challenge: | Existing studies focus on contrastive learning on the instance level without discriminating the contribution of each word. |
| Approach: | They propose a hierarchical contrastive learning mechanism which can unify semantic meaning in the input text. |
| Outcome: | The proposed model outperforms baselines on storytelling, paraphrasing, dialogue generation, and storytelling tasks. |
Copied to clipboard
| Challenge: | Existing work has shown that the optimization of variational autoencoders suffers from the posterior collapse problem. |
| Approach: | They propose a variational autoencoder that couples a VAE model with a deterministic autoencoding model and improves the parameters via weight sharing and decoder signal matching. |
| Outcome: | The proposed model improves on benchmark datasets and improves diversity of dialogue generation. |
Copied to clipboard
| Challenge: | Existing dialogue systems do not utilize quality dimensions specifically designed for dialogue evaluation to guide the response generation during training. |
| Approach: | They propose a two-stage framework which generates and utilizes conversation evaluation as explicit feedback during training. |
| Outcome: | The proposed framework generates and utilizes conversation evaluation as explicit feedback during training. |
Copied to clipboard
| Challenge: | Current text generators require sampling from a modified softmax to avoid degenerate text . entmax sampling creates a mismatch between training and testing conditions . |
| Approach: | They propose to use entmax transformation to train and sample from a sparse language model to avoid degenerate text. |
| Outcome: | The proposed model improves fluency and consistency, fewer repetitions, and n-gram diversity closer to human text. |
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have reshaped the field of natural language processing (NLP) however, fundamental NLP tasks that involve linguistic analysis still play essential roles in the field. |
| Approach: | They propose to use constituency parsing to improve performance of LLMs on deep syntactic parse trees to prompt LLM chunking, filter out low-quality chunks and add remaining chunks to prompts to instruct LLM for parser. |
| Outcome: | The proposed approach improves LLMs' performance on constituency parsing on English and Chinese benchmark datasets. |
Copied to clipboard
| Challenge: | Current large language models (LLMs) are ineffective in learning domain knowledge and aligning with human preference. |
| Approach: | They propose a benchmark LLM for Chinese medical domain that uses pre-training, supervised fine-tuning and RLHF to train LLMs. |
| Outcome: | The proposed LLM performs better than existing LLMs in the Chinese medical domain. |
Copied to clipboard
| Challenge: | Existing studies have focused on mitigating social biases in context-free representations, with recent shift to contextual ones. |
| Approach: | They propose an approach to mitigate social biases in a large pre-trained contextual language model . they propose lexical co-occurrence-based bias penalization in the decoder units . |
| Outcome: | The proposed approach reduces biases in fill-in-the-blank sentences and summarizes . it also reduces the biased representations in the frameworks, the authors show . |
Copied to clipboard
| Challenge: | Existing approaches to improve dialogues with random sampling are inefficient due to the large number of eligible responses with high action values. |
| Approach: | They propose a dual-granularity Q-function that extracts actions based on a grained hierarchy . they use offline RL and learn from multiple reward functions designed to capture emotional nuances in human interactions. |
| Outcome: | The proposed approach outperforms baselines across automatic metrics and human evaluations. |
Copied to clipboard
| Challenge: | Large language models are increasingly deployed in multi-turn settings such as tutoring, support, and counseling where reliability depends on preserving consistent roles, personas, and goals across long horizons. |
| Approach: | They propose a framework that decomposes LLM–LLM conversations into a modular, stability-first framework that allows for a stable persona-driven agent simulation for multi-turn dialogue generation. |
| Outcome: | The proposed framework decomposes the LLM-based model into four main components: persona creation, plausibility validation, and natural-language persona crafting. |
Copied to clipboard
| Challenge: | a recent study shows that inappropriate language can cause models to output profanity . authors propose a training framework to prevent such outputs from hurting the usability of models . |
| Approach: | proposed training framework eliminates the causes that trigger the generation of profanity . authors propose a framework that leverages a short list of profans to prevent this . |
| Outcome: | a proposed training framework can prevent models from generating profanity . the proposed framework leverages a short list of profanities examples . |
Copied to clipboard
| Challenge: | Recent advances in dialogue generation have inspired a number of studies on dialogue systems . however, current datasets are limited in size and the environment for training agents is relatively unsophisticated. |
| Approach: | They propose to use a context-generator to generate travel and flight restrictions to train agents. |
| Outcome: | The proposed model achieves a score of 0.17 while humans can reach 0.91 . the proposed model is based on a large dataset that contains 301,427 goal-oriented conversations . |
Copied to clipboard
| Challenge: | Existing studies have tried to introduce discrete or Gaussian-based latent variables to address the one-to-many problem, but the diversity is limited. |
| Approach: | They propose a diffusion model to enhance the diversity of dialogue generation by using continuous latent variables instead of discrete ones. |
| Outcome: | The proposed model greatly enhances diversity of dialog response while keeping the coherence. |
Copied to clipboard
| Challenge: | Existing approaches to generate conversational dialogue produce uninteresting, predictable responses. |
| Approach: | They propose a method to collect and determine more diverse data from conversational participants . they use dynamically computed corpus-level statistics to determine which conversational participant to collect data from . |
| Outcome: | The proposed method produces significantly more diverse data than baseline methods and better results on emotion classification and dialogue generation tasks. |
Copied to clipboard
| Challenge: | Recent large-scale pretrained models are built upon a multi-input single-output paradigm . tasks compete for a shared output channel, creating mutual exclusion effects . |
| Approach: | They propose a multi-input single-output (MISO) paradigm for large pretrained models . they propose unified training framework that enables concurrent multi-task outputs . |
| Outcome: | Experiments on autonomous driving platform show that MIMO-VLA outperforms state-of-the-art models in MIMO settings. |
Copied to clipboard
| Challenge: | Existing methods to learn vital information from dialogue context with limited data are limited due to limited words in utterances and huge gap between dialogue and its summary. |
| Approach: | They propose an unsupervised strategy to learn vital information from dialogue context . the proposed model uses a hypothetical foundation that a superior summary approximates a replacement of the original dialogue . |
| Outcome: | The proposed model outperforms existing models on a number of datasets. |
Copied to clipboard
| Challenge: | X-Eval is a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users. |
| Approach: | They introduce a two-stage instruction tuning framework to evaluate text in both seen and unseen aspects customized by end users. |
| Outcome: | The proposed framework improves the model’s ability to follow evaluation instructions and enhances the learning stage to better assess text quality. |
Copied to clipboard
| Challenge: | Generative dialogue systems tend to produce generic and boring responses, causing boring conversations . a novel commonsense knowledge-aware dialogue generation model is proposed to solve this problem . |
| Approach: | They propose to retrieve and introduce knowledge facts from knowledge graphs to reduce boring conversations . they use a Felicitous Fact mechanism to help the model focus on context-relevant knowledge facts . |
| Outcome: | The proposed model outperforms the state-of-the-art approach in most experiments. |
Copied to clipboard
| Challenge: | Experimental results show that meta-words can be used to generate open domain dialogues . human-machine conversation is a fundamental problem in NLP . |
| Approach: | They propose a goal-tracking memory network that formalizes meta-word expression as a target in response generation and manages the generation process with a state memory panel and a controller. |
| Outcome: | The proposed model outperforms state-of-the-art generation models in response relevance, response diversity, and accuracy. |
Copied to clipboard
| Challenge: | Existing evaluation metrics for natural language generation (NLG) tasks face the challenges on generalization ability and interpretability. |
| Approach: | They propose a metric that evaluates natural language generation tasks as an instruction-style question answering task and utilizes instruction-tuned pre-trained language models without training on evaluation datasets. |
| Outcome: | The proposed metric achieves state-of-the-art performance in untrained metrics for evaluating text summarization and dialogue generation, which exhibits strong dimension-level / task-level generalization ability and interpretability. |
Copied to clipboard
| Challenge: | Pre-trained language models have shown great dialogue generation capability in different scenarios, but the huge VRAM consumption when fine-tuning them is one of their drawbacks. |
| Approach: | They propose a parameter-efficient framework for knowledge-enhanced dialogue generation that leverages external knowledge documents and knowledge graphs to enhance its generation capabilities. |
| Outcome: | The proposed framework outperforms baseline methods on multiple evaluation metrics on Wizard of Wikipedia and CMU_DoG datasets. |
Copied to clipboard
| Challenge: | Current state-of-the-art neural dialogue models learn from human conversations . however, due to the open-ended nature of human conversations, the quality of training data varies . |
| Approach: | They propose a data manipulation framework to augment and highlight effective training samples . they also propose to increase its manipulation skills through gradient descent with validation samples a reshaping framework to proactively restructure the data distribution towards reliable samples is also proposed . |
| Outcome: | The proposed framework improves the performance of open-domain neural dialogue models with respect to evaluation metrics and human judgments. |
Copied to clipboard
| Challenge: | Large language models (LLMs) enabled dialogue systems are one of the central modes in human-machine interaction. |
| Approach: | They propose a benchmark task for dialogue element MOdeling and Element Awareness and a new benchmark for dialogue agent interaction that allows the agent to model dialogue elements via imitation learning. |
| Outcome: | The proposed agent performs well in both dialogue element modeling and out-of-domain tasks. |
Copied to clipboard
| Challenge: | Recent advances in neural models have shown promising progress on this task, but key challenges remain . |
| Approach: | They propose a framework that can decouple dialogue generation from item recommendation . they use a response template generator and item selector to generate a responses template . |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on the benchmark ReDial. |
Copied to clipboard
| Challenge: | Neural network-based sequence-to-sequence models suffer from low diversity in open-domain dialogue generation. |
| Approach: | They propose a way to diversify dialogue generation by leveraging non-conversational text . they collect large-scale corpus from forum comments, idioms and book snippets . |
| Outcome: | The proposed model produces significantly more diverse responses without sacrificing relevance with context. |
Copied to clipboard
| Challenge: | Graph-to-text (G2T) generation is an important task in natural language generation as it renders graphs accessible to non-technical users in downstream applications such as question answering. |
| Approach: | They propose a metric that correctly identifies factual faithfulness and uses it to determine if a triple is present in a generated text. |
| Outcome: | The proposed metric achieves highest correlation with human annotations on data correctness, data coverage, and relevance. |
Copied to clipboard
| Challenge: | a variety of personas can be elicited from large language models, but they are opaque and unpredictable. |
| Approach: | They propose an approach to dialogue generation that retrieves relevant schemas to condition a large language model to generate persona-based responses. |
| Outcome: | The proposed method captures habitual knowledge and generates persona-based responses from a large language model. |
Copied to clipboard
| Challenge: | Existing models that use millions of parameters on massive data are inefficient and lack interpretability. |
| Approach: | They propose a model with a latent structure that is easily transferable from the general domain to downstream tasks in a lightweight and transparent way. |
| Outcome: | The proposed model performs better than four strong baseline models in terms of automatic and human evaluations and is 5x faster than the strongest baseline model. |
Copied to clipboard
| Challenge: | Similes are a crucial part of creative writing, but there is still a lack of evaluation metrics for simile generation. |
| Approach: | They propose to use similes as a tool to evaluate simile generation metrics . they propose to combine five criteria and automatic metrics for each criterion . |
| Outcome: | The proposed metrics are significantly more correlated with human ratings from each perspective compared with prior automatic metrics. |
Copied to clipboard
| Challenge: | Recent advances in large-scale pre-training provide large models with the potential to learn knowledge from the raw text. |
| Approach: | They propose a posterior-based reweighing and noisy training strategy to exploit generated knowledge in dialogue generation. |
| Outcome: | Empirical results show that the proposed methods outperform the state-of-the-art methods in unsupervised knowledge-grounded conversation. |
Copied to clipboard
| Challenge: | Emotion-focused and strategy-driven chain-of-thought (ESCoT) is a new paradigm for emotional support dialogues. |
| Approach: | They propose an emotional support response generation scheme to improve interpretability . they generate a dataset and develop a model to generate dialogue responses with better interpretability. |
| Outcome: | The proposed scheme can generate dialogue responses with better interpretability. |
Copied to clipboard
| Challenge: | telemedicine is a medical practice that provides patient care remotely using video conferencing tools. |
| Approach: | They build large-scale medical dialogue datasets to facilitate research . they pretrain several models on the Chinese MedDialog dataset and compare their performance . |
| Outcome: | The proposed datasets show that models trained on MedDialog can generate doctor-like medical dialogues. |
Copied to clipboard
| Challenge: | Existing approaches to multi-task learning suffer from interference among datasets or fail to effectively reuse knowledge and skills learned from other datasets. |
| Approach: | They propose a sparsely activated modular network with a well-rounded set of operators and instantiate each operator with an independent module. |
| Outcome: | The proposed model outperforms state-of-the-art supervised approaches on 4 datasets with only 10% training data thanks to the modular architecture and multi-task learning. |
Copied to clipboard
| Challenge: | Despite widespread adoption, neural conversation models have yet to exhibit natural chat capabilities with humans . despite their widespread adoption in society, chatbots have yet not shown natural chat capability . |
| Approach: | They propose a causality-enhanced method to enhance the impact of causality at the utterance level in training neural conversation models. |
| Outcome: | The proposed method improves diversity and agility of loss functions and still needs improvement . the proposed method is based on a CausalDialogue dataset . |
Copied to clipboard
| Challenge: | Existing controllable dialogue generation models focus on single attribute and lack generalization capability to out-of-distribution multiple attribute combinations. |
| Approach: | They propose a compositional generalization model that learns from seen attributes and generalizes to unseen combinations. |
| Outcome: | The proposed model can learn from seen attribute values and generalize to unseen combinations. |
Copied to clipboard
| Challenge: | Existing approaches to persuasive dialogue generation suffer from stance oscillation and low informativeness. |
| Approach: | They propose reinforced instructional prompting, a method that ensures speaker characteristics consistently guide all stages of dialogue generation. |
| Outcome: | The proposed method ensures speaker characteristics guide all stages of dialogue generation and aligns language use with speakers’ native languages to better capture cultural nuances. |
Copied to clipboard
| Challenge: | In recent years, large language models (LLMs) have proven effective in generating coherent and contextually appropriate responses. |
| Approach: | They examine the ability of a model to adapt to the interlocutor's profile by masking or disclosing information about interlucutor . |
| Outcome: | The proposed model generalises well across topics, but struggles with unfamiliar interlocutors. |
Copied to clipboard
| Challenge: | NoteChat is a cooperative multi-agent framework for generating patient-physician dialogues . evaluator finds it outperforms state-of-the-art models for generating clinical notes . clinical documentation is largely done by physicians at both steps . |
| Approach: | They propose a cooperative multi-agent framework leveraging Large Language Models to generate patient-physician dialogues. |
| Outcome: | The proposed framework outperforms state-of-the-art models for generating clinical notes . it can engage patients directly and help clinical documentation, a leading cause of physician burnout . |
Copied to clipboard
| Challenge: | Large language models have demonstrated remarkable performance in various NLP tasks, but are typically computationally expensive and difficult to be deployed in resource-constrained environments. |
| Approach: | They propose a knowledge distillation method based on a reward function induced from large language models. |
| Outcome: | The proposed method outperforms traditional methods on multiple datasets and tasks. |
Copied to clipboard
| Challenge: | Existing studies have shown that commonsense knowledge-aware models can improve informativeness while reducing the hallucination issue. |
| Approach: | They propose a task to use commonsense knowledge in other languages to enhance the current dialogue generation by using commonsensical knowledge in different languages. |
| Outcome: | The proposed model improves the current dialogue generation while reducing the hallucination issue. |
Copied to clipboard
| Challenge: | a large language model is used to decompose global feedback into a lightweight reward model. |
| Approach: | They propose a large language model based reward decomposition framework for dialogue agents . they use a frozen large language modeling framework to decompose global feedback . |
| Outcome: | The proposed framework infers fine-grained local rewards from a single session-level feedback signal. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) extend their capabilities through function-calling (FC) however, obtaining and annotating real function-called data is challenging, and synthetic data from existing pipelines suffers from unreliable APIs, limited tool scalability, insufficient diversity, and weak quality control. |
| Approach: | They propose a pipeline for generating FC training data using reliable tools and a multi-agent framework that supports a dialogue generation system that produces conversations spanning diverse scenarios. |
| Outcome: | The proposed pipeline outperforms open-source models in in-domain FC performance and out-of-domain generalization while reaching FC capabilities comparable to some of the latest API-based models. |
Copied to clipboard
| Challenge: | Existing approaches to persuasion generate generic or weakly grounded responses even when such cues are identified. |
| Approach: | They propose a meta-cognitive autonomous intelligent agent framework for complex persuasion that coordinates perception management, mental-state inference, strategy execution, memory maintenance, and performance evaluation. |
| Outcome: | The proposed framework achieves a higher persuasion success rate than baselines. |
Copied to clipboard
| Challenge: | Social norms govern culturally appropriate behavior in communication, enabling dialogue systems to produce coherent and socially acceptable outputs. |
| Approach: | They propose a framework for generating and annotating socially grounded dialogues in Chinese, English, and Korean. |
| Outcome: | The proposed framework outperforms existing frameworks in refinement quality, dialogue naturalness, and generalization performance. |
Copied to clipboard
| Challenge: | Existing autoregressive models for dialogue generation suffer from high latency and stability issues. |
| Approach: | They propose a non-autoregressive (NAR) zero-shot spoken dialogue generation model based on flow-matching. |
| Outcome: | The proposed model outperforms existing models in speech generation due to poor speech intelligibility and turn-taking precision. |